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= (54) Title: VIDEO RECORDING AND IMAGE CAPTURE DEVICE 




O (57) Abstract: A video recording and image capture device for documenting surgical procedures that includes a main board for 
® executing a plurality of software, a multimedia interface (100) operable to receive a video signal and process it into an MPEG layer 
stream, the video interface (35) connected on a first bus to the main board, a hard drive (50) to record an MPEG layer stream as a 
Q file, an optical media drive to write an MPEG layer stream as a file, the hard drive and the optical media drive operably connected 
^ on a second bus, the bus being vertically stacked and connected to the main board, and a touch screen interactive for user control, 
^ connected to the main board on a second bus to control the video interface. 
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Title Of Invention 

Video Recording and Image Capture Device 

Prior Application 

[oooi] Applicant claims priority benefits under 35 U.S.G. §1 19(e) of 
U.S. Provisional Patent Application Serial No. 60/410,456 filed September 13,. 
2002. 

Field Of The Invention 

[0002] The invention relates generally to device for video recording 
and image capture, and more particularly to such a device for image based 
documentation of surgical procedures. The invention also relates to means to 
process signals into an MPEG layer stream. 

Background Of The Invention 

[0003] The maxim that "a picture is worth a thousand words" is 
more true than ever in image based documentation of surgical procedures. 
There patients' lives and physicians' reputations are at stake. The early 
history of image based documentation is littered with crude attempts at 
utilizing photographic film to capture anatomical curiosities and 
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ground breaking surgical advances for teaching purposes. However, little 
attempt was made to provide documentation of routine cases. Average 
patients simply did not merit this special consideration. 

[0004] With the advent of analog cameras coupled to fiber optics, 
physicians began displaying some surgical patient images on video monitors 
in the operating room. This was especially true in endoscopic surgeries 
where physicians peer inside patients' body cavities normally only viewable 
with open surgery. Attempts made to systematically record all patient 
procedures on videotape required large and cumbersome archives of 
videotapes. 

[0005] Although analog cameras are still used, solid state image 
cameras coupled to endoscopes and other medical instruments are now 
standard. These cameras produce images in digital format. Such format 
allows convenient and efficient image transfer, review, and archival. 

[0006] One method for archiving digital images is suggested in U.S. 
Patent 6,067,075 to Pelanek. Therein, a workstation is disclosed for 
transferring and archiving patient images previously stored in the memory of 
diagnostic equipment. However, this method does not disclose 
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contemporaneously saving images in a permanent location, meaning that the 
equipment is subject to "downtime" as data is extracted from its memory. 

[0007] Once image data has been extracted and archived it must 
be made available to those in a position to best make use of it, the treating 
physician. Ironically in a circular manner, the person to whom eventual 
delivery of images is made is the same person who used the diagnostic 
equipment to record the images in the first place who must now await it being 
made available to him. Thus, it would be advantageous to the physician to 
have the data available at the conclusion of the surgical procedure or series 
of surgeries. Consequently, equipment downtime for data extraction also is 
eliminated increasing efficiency of equipment and facility utilization. 

[0008] Image data availability, however, is only of value when the 
data can be read and images displayed readily. Thus, exotic and unusual 
methods of storing and reading image data chain physicians. Most 
convenient are displays in NTSC and PAL standards and devices that can 
play image data on these displays. NTSC is the common television standard 
in the U.S., while PAL standards predominate in Europe and in parts of Asia. 
Additionally, most convenient for medical personal, is for images and video to 
be viewable utilizing common off-the-shelf optical media players (i.e. set-top 
DVD players) and/or standard personal computers. 
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[0009] U.S. Patent 5,045,955 to Ikeda discloses an apparatus 
coupled to a digital tape drive for recording and reproducing high-definition 
medical images having specific analog matrix exceeding that of NTSC or PAL 
standards. Typically, these images can only be produced by specialized 
imaging equipment and can only be viewed on highly specialized monitors. 
They are incompatible with NTSC or PAL standards and thus are inapplicable 
to the use of documenting procedures where analog or digital cameras 
provide a video signal to be displayed . 

[00010] Other suggestions have been made to integrate images into 
a medical setting. Therein, imaging is primarily related to diagnosis rather 
than documentation; resulting in files solely consisting of visually relevant 
components and omitting narration by the treating physician. 

[00011] Suggestions to incorporate equipment in surgical suites fail 
to consider issues relevant to logistics of placing equipment. Surgical suites 
include a plurality of equipment. Vertically stacking equipment in shelves, i.e. 
racking, advantageously conserves space. However, this limits the readily 
available user-operator access to front face plates. Equipment that 
incorporates space saving advantages while providing maximum user- 
operator access, therefore, is highly desired. 
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[00012] Therefore, what is desired is a device that produces and 
saves a surgical documentary recording file that incorporates both video and 
audio to a transportable and common media contemporaneously during the 
surgery. 

[00013] What is also desired is a device that formats a video signal 
into a plurality of video formats for display, displays an Image stream, and 
allows a user to capture still images and save same as a still graphic file to 
the same media as the documentary recording file. 

[00014] It is further desired that the device and the parts that the 
user interacts with are convenient and accessible. 

[00015] Also, it is desired that the device is capable of "feed through" 
of real-time video signals to a plurality of display devices, in a plurality of 
video formats, when the device is in a standby mode, when the device is off, 
or in the event when the device malfunctions. 

[00016] Further, what is desired is an interactive tutorial which allows 
a user to manipulate the files saved. 

[00017] These and other objectives are met by the embodiments of 
the present invention. 
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Summarv Of The Invention 

[00018] In accordance with one embodiment, a device for medical 
video recording includes an endoscope, and an imager for converting energy 
such as electromagnetic energy, direct current energy and the like, which is 
received from said endoscope to signals that are contemporaneously stored 
onto said media. 

[00019] In accordance with one embodiment of the invention, a 
device is provided that encodes a video signal into a documentary recording 
file formatted in an MPEG-2 layer. 

[00020] In accordance with one embodiment of the invention, a 
multimedia interface to process a video signal and audio signal into a first and 
second digital data stream having common characteristics is provided. 

[00021] In accordance with one embodiment of the invention, a 
recording mode for recording a video stream during a surgical procedure is 
provide for surgical documentation. 

[00022] In accordance with one embodiment of the invention, a 
means for a video signal to be displayed by a display unit during recording 
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mode, or when the device is in a standby mode, or when the device is off, or 
when the device has malfunction, is provided. 

[00023] In accordance with one embodiment of the invention, an 
archival mode is provided for review, edit and playback of a documentary 
recording file and graphic file. 

[00024] In accordance with one embodiment of the invention, a 
medical instrument having touch screen control includes a touch screen for 
entering control commands, a processor for receiving the control commands 
and for generating control signals to operate the medical instrument, a 
housing for enclosing the processor. The touch screen is movable between a 
first position protected by the housing and second position extended from the 
housing for entry of the control commands. 

[00025] In accordance with one embodiment of the invention, a 
multimedia interface for processing a video signal for recording video into a 
multiple frame layer includes a controller for an inter-ic bus for providing a 
multiple master digital connection, an analog to digital converter for 
converting a video signal to a first digital stream, the converter operably 
connected to the inter-ic bus, a video compression and decompression 
integrated circuit for encoding the first digital stream into a second digital 
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stream having frames and decoding a second digital stream, the video 
compression and decompression integrated circuit operably connected to the 
inter-ic bus a programmable buffer for selectively saving frames handled by 
the controller, the buffer operably connected to the controller and the video 
compression and decompression integrated circuit and the buffer inserting the 
frame into the second digital stream for decoding. 

[00026] In accordance with one embodiment of the invention, a 
method for recording an MPEG layer file for documenting surgical procedures 
while displaying an MPEG layer stream and n number selecting still image 
files corresponding to the MPEG layer stream, includes the steps of providing 
a first digital data stream comprising a video signal, providing a second digital 
data stream comprising an audio signal, multiplexing an MPEG layer data 
stream from the first and second digital data stream, streaming the MPEG 
layer data stream to a hard drive and an optical media drive operably 
connected on a vertically stacked bus, writing the MPEG layer stream to the 
hard drive and the optical media drive, displaying the MPEG layer stream on 
a display unit, selecting n number of frames from the MPEG layer 
stream.converting n frames to n still image files, and multiplexing the output 
signal to the display unit by adding n still image files. 



. WO 2Q04/025963 



PCT/US2003/029012 



-9- 

[00027] The terms "communicate", "communicating" and 
"communication" as used herein include both conveying data from a source to 
a destination, as well as delivering data to a communications medium, system 
or link to be conveyed to a destination. The term "communication" as used 
herein means the act of communicating or the data communicated, as 
appropriate. 

[00028] The invention and its particular features and advantages will 
become more apparent from the following detailed description considered 
with reference to the accompanying drawings. 

Brief Description Of The Drawings 

[00029] Fig. 1 is a schematic diagram of a Video Recording and 
Image Capture Device used in a surgical patient setting in accordance with 
the present invention; 

[00030] Fig. 2 depicts a front panel elevation view of a Video 
Recording and Image Capture Device of Fig. 1 ; 

[00031] Figs. 3 depicts a rear panel elevation view of a Video 
Recording and Image Capture Device of Fig. 1; 
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[00032] Fig. 4 is a schematic diagram of a Video Recording and 
Image Capture Device of Fig. 1; 

[00033] Figs. 5a, 5b, and 5c depict a Video Recording and image 
Capture Device of Fig. 1 ; 

[00034] Fig. 6 is a schematic diagram of a multimedia interface of 

Fig. 1; 

[00035] Fig. 7 depicts a schematic of interconnecting Video 
Recording and Image Capture Device and a display unit of Fig. 1; 

[00036] Figs. 8 through 1 3 depict use of a Video Recording and 
Image Capture Device through the interactive display of the touchscreen of 
Fig. 1; 

[00037] Fig. 14a and 14b depict a plan view a track advance system 
for a touchscreen of a Video Recording and Image Capture Device of Fig. 1; 
and 

[00038] Fig. 1 5 depict a Video Recording and Image Capture Device 
of Fig. 1 with touch screen fully retracted, touch screen extended and touch 
screen extended and deflected. 
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Detailed Description Of The Drawings 

[00039] The present invention will be described as used in 
connection with one or more endoscopes. It will be understood that other 
applications may be used equally effectively. Various frame displays and 
icons having particular graphical representations are described in connection 
with the functions of the present invention. It will be understood that other 
graphical representations may be used equally effectively in communicating 
to users the function performed therein. 

[00040] Herein, image and image stream refer to the perception of 
the user utilizing their audiovisual capabilities; an image stream may also 
include an auditory component. Video signal, digital signal, analog signal, 
data stream, or the like refer to electrical signals in the present invention and 
electrical equipment operably connected and/or associated with the present 
invention. 

[00041] Fig. 1 is a schematic diagram of a Video Recording and 
Image Capture Device used in a surgical patient setting in accordance with 
one embodiment of the present invention. Patient 5 is being examined by 
user 10 with an endoscope 15. User 10 may be a physician, surgeon, nurse, 
or other qualified professional or para-professional. Video Recording and 
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Image Capture Device (imager) 100 has been placed into a video recording 
mode. A camera head 20, such as a charge coupled device (CCD), CMOS, 
or CCI chip, is coupled to endoscope 15 to receive and produce a video 
signal 300 (see Fig. 4) of a body cavity of patient 5. Video signal 300 results 
in an image stream 25 when displayed on a display unit. 

[00042] As user 10 manipulates endoscope 15, user 10 controls 
camera head 20 with camera control unit (CCU) 30 and observes image 
stream 25 on a display unit, for example external video screen 35. Imager 
100 is operably connected to CCU 30 to receive video signal 300. Device is 
also operably connected to external video screen 35, microphone 40, printer 
45, and network 50 through standard ports. In one embodiment, imager 100 
is operably connected to camera head 20 to receive video signal 300 and 
control camera head 20, obviating the need for CCU 30. 

[00043] As user 10 examines and treats patient 5, imager 100 is 
recording a digital data stream representing image stream 25 on optical 
media drive (OMD) 125 (see Fig. 2) and saving a backup copy to hard drive 
(HDD) 120 (see Fig. 4)for a plurality of purposes. During this period user 10 
may provide narration to the examination. Microphone 40 or an independent 
audio recording system captures the narration and converts it into audio 
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signal 31 4i (see Fig. 6) or 31 6i (see Fig. 6), respectively, collectively audio 
signal 315 (see Fig. 6). 

[00044] Upon encountering a situation requiring further investigation, 
user 10 utilizes an image capture mode to save and freeze a first image from 
image stream 25 for further investigation. Using imager 100, a second image 
substantially like the first image can be superimposed on image stream 25. 
Upon encountering further situations that attracts the attention of user 10, a 
plurality of second images substantially corresponding to respective first 
images found of interest can be saved and concurrently superimposed on 
image stream 25. A file corresponding to second image can be printed with 
printer 45 and/or forwarded over network 50 to other persons for consultation. 

[00045] Figs. 2 and 3 depict a front panel and rear panel elevation 
view, respectively, of a Video Recording and Image Capture Device in 
accordance with one embodiment of the present invention. Fig. 4 is a 
schematic diagram of a Video Recording and Image Capture Device in 
accordance with one embodiment of the present invention. Imager 100 is 
substantially housed in chassis 105 and includes a plurality of components: 
power supply 110, microprocessor main board (MMB) 115, hard drive (HDD) 
120, optical media drive (OMD) 125, communication interface 130, 
multimedia interface 135, speaker 140, digital video interface 150. Chassis 
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105 includes an add-on tray 105a that advantageously houses touchscreen 
145. 

[00046] Power supply 1 1 0 is connected to an AC power supply with 
an electric cord at power port 1 10a located on chassis back panel 105b. 
When power switch 110b of chassis front panel 105c is engaged, power 
supply 110 provides suitable power to components of imager 100. Power 
supply 110 conforms to IEC 601-1 isolation requirements, provides power 
meeting medical grade standards of 145 Watts, includes a power correction 
factor, and is capable of automatically handling automatically an AC voltage 
range of 1 00 to 250 VAC, 50-60 Hz. 

[00047] Microprocessor main board (MMB) 115 executes software 
and includes a central processor unit ("processor"), random access memory, 
a plurality of expansion slots, a BIOS chip, and on-board sound and graphics 
capabilities on a footprint convenient for chassis 105. Therein, it may be that 
an Intel Pentium III with a processing speed of at least 800 MHz; an Intel 815 
chip set; at least three (3) PCI and one (1) AGP slot; SDRAM of at least 128 
MB; on-board AGP graphics; and a flash upgradeable BIOS chip wherein a 
customized logo may be loaded, is provided on an ATX motherboard. 
Further, MMB 115 preferably includes port panel 115a to connect to other 
devices and or networks via serial, parallel, USB and ethernet, and to connect 
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to mouse, keyboard, and video monitor; a Intel 40-pin DVO motherboard 
connector, or similar, and support for the connector. 

[00048] Hard drive (HDD) 120 and optical media drive (OMD) 125 
maybe IDE or Enhanced IDE (alternatively IDE) compatible data storage 
media drives operably connected MMB 115 by a vertically stacked IDE bus 
116. HDD 120 maybe a magnetic hard drive having at least 40 Gigabytes of 
storage and minimal access time, as such a drive from Maxtor having EIDE 
access time of 8.0 ms, 7200 rpm disk speed is preferred. OMD 125 is 
preferably a DVD+RW drive capable of reading and writing data to an optical 
media disk, such as a compact disk (CD) and/or a digital versatile disk (DVD). 

[00049] Communication interface 130 is any kind of network or 
proprietary communications interface. Therein, for example, a network card 
that is capable of interfacing with the Karl Store®, Inc. Storz Communication 
Bus (SCB) is preferred. 

[00050] Multimedia interface 1 35 connects to MMB 1 1 5 via a 
Peripheral Component Interconnect (PCI) local bus to provide record and 
write image stream 25 originating from camera head 20. Speaker 140 is 
housed in chassis 105 and provides auditory capabilities for imager 100. 
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[00051] Digital video interface 150 is operably connected to MMB 
115 to create a video signal conforming to the digital visual interface (DVI) 
standard. Therein, a digital video interface 150 is preferably physically 
implemented as a printed circuit board having an Intel 40-pin DVO connector, 
or similar, to MMB 115 and a DVI-D output connector in expansion slot 105d. 

[00052] A touchscreen 145 is provided as illustrated on Figs. 5a, 5b, 
and 5c in accordance with one embodiment of the present invention. A 
surface 145a responsive to touch by an operator, such as user 10, and a 
display 400 capable of showing the functions of imager 100 are included in 
touchscreen 145. Preferred is a touchscreen manufactured by Optrex Inc. of 
Plymouth, Ml. A video connection to MMB 115 is made to the corresponding 
DVI-D output and a data and power connection is made between standard 
RS-232 serial ports. 

[00053] Touchscreen 145 is advantageously housed in tray 105a 
(see Fig. 14a) of imager 100 within chassis 105. Therein, it is mounted within 
a track advance system (TAS) 146 (see Fig. 14 a) so that touchscreen 145 is 
secure and is relatively flush with a front face of chassis 105 as depicted in 
accordance with one embodiment of the present invention in Fig 18. 
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[00054] TAS 146 allows user 10 to advantageously use the space 
available when equipment is racked. User 10 presses a button or other 
releasing mechanism to release touchscreen 145 and slides touchscreen 145 
away from chassis 105 and out of tray 105a as indicated by the arrows as 
depicted in accordance with one embodiment of the present invention in Fig. 
5b. To make touchscreen 145 more user friendly and visible, user 10 is able 
to tilt touchscreen 145 at an angle as indicated by the arcuate arrows in 
accordance with one embodiment of the present invention in Fig. 5c. 

[00055] Fig. 1 5 discloses the touch screen in various states of 
deployment. For example, 101 shows one embodiment in which the touch 
screen is fully retracted, however, other embodiments will not have the touch 
screen fully retract. 102 shows the touch screen extended out and 103 
shows the touch screen extended out and deflected from the plane of the 
housing. 

[00056] Figs. 14a and 14b depict a plan view of a track advance 
system for a touchscreen of a Video Recording and Image Capture Device in 
accordance with one embodiment of the present invention. A platform 144 
(shown advanced out of tray 105a) disposed to tray 105a is operable with 
rails 143a and 143b and is guided by tracks 147a and 147b by bearings or 
other friction reducing mechanisms as depicted in accordance with one 
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embodiment of the present invention in Fig.14a. Releasing mechanism 143d 
includes one or more components that selective to user desire, release 
touchscreen 145 in order to advance it. Releasing mechanism 143d further 
may include one or more springs 143e. 

[00057] Platform 144 may be of any suitable design to hold 
touchscreen 145 even when placed at an angle from horizontal. Touchscreen 
145 is operative with imager 100 through cables and connectors. 

[00058] Rails 143a and 143b have stops 143c (only partially shown 
for clarity) operable with tracks 147a and 147b to prevent advancing 
touchscreen 145 beyond a predetermined point. 

[00059] TAS 146 includes on or more hinge 142, such as edged 
hinge 142a and 142b, or center hinge 143c a center hinge as depicted in 
accordance with one embodiment of the present invention in Fig.14b. Hinge 
142a and 142b cooperate to angle platform 144 so that user 10 can during 
the surgery interactively access touchscreen 145. To prevent changing angle 
of the platform 144 or accidental closure, one or more tapping mechanisms 
are disposed with hinge 142, that make it resistant to unintentional 
movement. 
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[00060] Fig. 6 is a schematic diagram of multimedia interface 135 in 
accordance with one embodiment of the present invention. Multimedia 
interface 135 is physically implemented on one or more printed circuit boards, 
also commonly referred to as expansion cards, having a plurality of integrated 
circuits and a PCI bus connection 136 to MBB 115 for data transfer. Through 
bus 136 multimedia interface 135 also receives electric power. Audio and 
video connection ports, i.e. input and output ports, are physically implemented 
in expansion slots 105 and integrally connected to multimedia interface 135. 
In one embodiment, multimedia interface 135 is implemented as a PCI 
expansion card with bus connection 136 to MBB 115 and a further printed 
circuit board connecting directly to the PCI expansion card. 

[00061] Resident on multimedia interface 135 is an Inter-IC bus 
operatively controlled by controller 200. Controller 200 implements the Inter- 
IC bus as a multi-master bus to connect circuits to PCI interface 210. Router 
220 is provided as a field programmable gate array and has programmable 
read only memory that is accessible via a port, such as a JTAG port. 

[00062] In recording mode, imager 1 00 receives the input of video 
signal 300 and audio signal 315 and contemporaneously encodes both 
signals while writing the data stream to HDD 120 (see Fig. 4) and/or media in 
OMD 125 (see Fig. 4). 
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[00063] Video signal 300 is received by multimedia interface 135 as 
analog video signal 304i or digital video signal 306i in input ports located in 
expansion slot 105d (see Fig. 3). The active input port is automatically 
detected by multimedia interface 135, as are active output ports. 

[00064] A relay 205 is operative to bypass video signal 300 to an exit 
port corresponding to the input port for display by an external monitor when 
imager 100 is not powered or imager 100 is in standby mode. Therein, relay 
205 includes a receiver for receiving a sense signal from software to indicate 
that the recording mode is engaged. If the sense signal is not received with a 
predetermined time, video signal 300 is bypassed. If imager 100 is not 
powered, a default mode of relay 205 bypasses the signal to the 
corresponding port, i.e. video signal 300 input on the S-video input is 
bypassed to an S-video output port. 

[00065] Analog video signal 304i is received using composite video 
input or S-Video input. If analog video signal 304i is received when imager 
100 is not electrically powered or recording mode is not engaged, video signal 
300 is bypassed using bypass relay 205. Received analog video signal 304i 
is digitized using analog to digital converter 240. Therein, the NTSC or PAL 
standard analog video signal 304i is digitized to first internal data stream, 
digital data stream (DDS) 310. A digitized data stream having 4:2:2 



WO 2004/025963 



PCT/US2003/029012 



-21 - 

luminance to chrominance (YUV) pixels is preferred. Other data stream 
configurations may also be used. In particular, a data stream having 8:2:2 
YUV may be advantageously used in connection with CCU 30 (see Fig. 1 ) 
which is capable of producing higher analog video frame quality. DDS 310 is 
then streamed via router 220 to video media compression and 
decompression integrated circuit (V-codec) 230 where it is encoded. 

[00066] Digital video signal 306i is received using the SDI digital 
video signal input. If digital video signal 306i is received when imager 100 is 
not electrically powered or recording mode is not engaged, video signal 300 is 
bypassed using bypass relay 205. Received signal 306i is processed by SDI 
receiver 250 and converted to a first internal data stream, DDS 310. A 
digitized data stream having a 4:2:2 luminance to chrominance (YUV) pixels 
is preferred; although other data stream configurations may also be used. 
DDS 310 is streamed via router 220 to V-codec 230 where it is encoded. 

[00067] Inputs for audio signal 314i originating from a stereo line and 
audio signal 31 6i originating from microphone 40 are provided for recording a 
desired audio signal such as dictation. Both inputs may be combined to 
create a single audio signal 315 or used individually. Audio signal 315 is 
received by audio compression and decompression integrated circuit (A- 
codec) 260 and converted to a second internal data stream, digital data 
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stream for audio (DDSA) 312, and passed to automatic gain control 270 
disposed on the Inter-IC bus. DDSA 312 is then streamed to V-codec 230. 

[00068] V-codec 230 is provided as embedded software, preferably 
operating on a LINUX or UNIX embedded platform, on one or more integrated 
circuits on the Inter-IC bus and operatively connected to controller 200. Also 
operatively connected are one or more buffer memories, such as SDRAM 
integrated circuits. Configuration settings of V-codec 230 are stored on an 
associated erasable electronic programmable read only memory (EEPROM 
or EPROM) circuit, or similar. The embedded software of V-codec 230 
executes an algorithm to decode and/or encode a Motion Picture Experts 
Group (MPEG) layer, such as MPEG, MPEG-2 and/or MPEG-4, data stream 
(MDS) 320. MDS 320 advantageously utilizes high compression rates 
achieved by using ad index frame and noting a sequence of changes to that 
index frame in subsequent images. Therein, MDS 320 is comprised of a 
stream of frames 322. 

[00069] Algorithms of this type are known to execute file formatting 
appropriate for CD-R and a plurality of DVD media storage and play. 
Typically, MDS 320 is preferred to encode in a file format designated as 
"VOB" applicable to DVD+RW media storage and play. It should be 
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appreciated that the present invention may be adapted readily to utilize other 
compression and decompression algorithms. 

[00070] V-codec 230 multiplexes DDS 310 and DDSA 312 into MDS 
320 which is then streamed to MMB 115. From there, MDS 320 is streamed 
to HDD 120 and to OMD 125 via vertically stacked IDE bus 116. Therein, 
HDD 120 writes MDS 320 to a magnetic disk and streams a copy to OMD 125 
for writing to an optical disk such as a CD-R or DVD media to create 
contemporaneous documentary recording file while the surgery is being 
conducted by user 10. If the write process on OMD 125 is interrupted or fails, 
a backup copy resides on HDD 120 for a subsequent write attempt after the 
conclusion of the surgery. 

[00071] A means for a video signal to be displayed by a display unit 
during recording mode is provided. The display unit may be external video 
screen 35 or touchscreen 145. Fig. 7 depicts a schematic of interconnecting 
imager 100 and a display unit in accordance with one or more embodiments 
of the present invention. An embodiment of video screen 35, external video 
screen 35a, is operable to receive an analog and/or digital signal using 
connectors for S-video, composite and/or SDI format. Therein, multimedia 
interface 135 senses the active output port and router 220 streams DDS 310 
accordingly to either SDI transmitter 280 to produce digital video signal 306x 
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or to digital to analog converter 290 to produce analog video signal 304x, 
respectively. In converter 290, common data stream DDS 310 is 
automatically converted to the appropriate NTSC or PAL standard analog 
signal in use by video screen 35a. 

[00072] Touchscreen 145 is operable to receive a video signal in 
digital visual interface (DVI) format, and an embodiment of video screen 35, 
external video screen 35b having touchscreen capabilities, is operable to 
receive a video signal in digital visual interface (DVI) format or analog monitor 
format. Therein, MMB 115 streams a copy of MDS 320 to resident AGP 
graphics support and/or DVI graphics support and digital video interface 150 
for output to touchscreen 145 and video screen 35b as required by the active 
output. 

[00073] Image capture mode is provided for saving a frame 322 (see 
Fig. 6) from MDS 320 substantially like image of image stream 25. User 10 
views an image of interest in image stream 25 and initiates instruction to 
"freeze" the image of interest. Since both reaction time on behalf user 10 and . 
processing time on behalf of imager 100 has passed when such an instruction 
has been received, a frame 322 substantially like image 26 is saved, wherein 
the substantiality is temporal. The freeze instruction is forwarded to 
multimedia interface 135. Therein, controller 200 instructs PCI interface 210 
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to forward the current frame 322 being handled to frame buffer 295, also 
known as frame grabber, which stores frame 322. 

[00074] Frame buffer 295 can be implemented as an integrated 
circuit, capable of storing and identifying a plurality n of frames 322 
corresponding to maximum number n frames capable of being stored 
according to the buffer size (hereinafter frame 322i designating the first frame 

322 stored, frame 322 2 the second, and frame 322 n the last frame 

stored). As shown, identification may be implemented by designating a first- 
in-first-out order, or similar order. Upon receipt of frame 322 1t buffer 295 
forwards a copy to router 220. Router 220 multiplexes frame 322i with DDS 
310 and streams the combined signal to the active output port for display as 
combined image. As described further herein in connection with image 
capture mode, user 10 is able to manipulate the position and size of the 
combined image within image stream 25 and on a display unit. 

[00075] A copy of frame 322i is saved to HDD 120, preferably in file 
format Joint Picture Experts Group JPEG layer corresponding to the MPEG 
layer such as MPEG, MPEG-2 and/or MPEG-4 layer, as a graphic file. A 
software application for conversion to other formats such as "TIFF," "BMP," 
and/or "FPX", or similar, is provided. 



. WO 2004/025963 



PCT/US2003/029012 



-26- 

[00076] Upon additional instruction by user 10 to capture further 
images, further corresponding frames 322 are saved in the manner 
described. Therein, frame 322 2 is multiplexed with frame 322i and DDS 310 
and the combined signal streamed to the active output for display on a display 
unit. 

[00077] An archival mode is provided for review, edit and playback of 
documentary recording file and a graphic file. Therein, the recording file is 
accessed and a digital data stream corresponding to MDS 320 is read from 
media of HDD 120 and/or OMD 125 and is streamed to V-codec 230 and is 
decompressed into a digital data stream corresponding to DDS 310. The 
decompressed digital data stream is then routed to the active port for display 
or transferred to MMB 115 for display on a display unit. 

[00078] Figs. 8 through 1 3 depict use of imager 100 through 
interactive display 400 of touchscreen 145 in accordance with one 
embodiment of the present invention. It should be appreciated that similar 
usage is achieved through use of other input devices, as for example mouse 
and keyboard, coupled to a display unit. 



[00079] Upon powering of imager 100, it is in standby mode and 
page 410 is shown as depicted in Fig. 8 in accordance with one embodiment 
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of the present invention. Display 400 is shown as page 410 providing a 
plurality of fields. The fields depicted include fields grouped to display 
surgical information 600, multimedia status 610, image panel 620, and control 
panel 630. In the embodiment illustrated, multimedia status 610 indicates 
that the optical media includes data saved from a previous surgical session. 
To use imager 100 for the current session and input patient data, user 10 
touches the desired field in surgical information block 600 to include the 
requisite data. 

[00080] Surgical information block 600 includes fields for 
biographical patient information, identity of treating physician, and additional 
information as may be convenient and necessary. If the field requires an 
alpha-numeric entry, alpha-numeric keyboard page 420 is displayed on top of 
page 410, as depicted in Fig. 9. User 10 enters the data by touch. Field 422 
contemporaneously displays the entry made. The user confirms the entry 
and is taken back to page 410 to make the next selection. If the desired field 
of frame 410 requires a numeric entry, numeric keyboard page 430 is 
displayed on top of page 410, as depicted in Fig. 10 according to one 
embodiment of the present invention. User 1 0 enters the data by touch. Field 
422 contemporaneously displays the entry made. The user confirms the 
entry and is taken back to page 410, now modified with additional date as 
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depicted in Fig. 11 according to one embodiment of the present invention, to 
make the next selection. 

[00081] Returning to Fig. 8, control panel 630 provides functions to 
control imager 100 including recording video, capturing images, muting audio 
input, and confirming choices. Other functions as may be convenient and/or 
necessary may also be included. 

[00082] To place device in recording mode to record a video file to a 
disk properly loaded in OMD 125, user 10 touches the designated icon, here 
illustrated as icon 632, in control panel icon 630. In response, icon 632 may 
change design, such as becoming highlighted. Concurrently, in image panel 
620, image 25 is displayed in image window 624 and image status bar 622 
displays confirmation of recording and elapsed recording as depicted in Fig. 
12. Similarly if recording is initiated via CCU 30, icon 632 becomes 
highlighted, image 25 is displayed in image window 624 and image status bar 
622 displays confirmation of recording and elapsed recording, also as 
depicted in Fig. 12 according to one embodiment of the present invention. To 
cease recording, user 10 touches highlighted icon 632 or engages the 
appropriate control on CCU 30. 
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[00083] To mute audio recording or conversely engage audio 
recording, user 10 touches the designated icon, here illustrated as icon 636, 
in control panel 630. In response, icon 636 may change design, such as 
becoming highlighted. To reverse the action, user 10 touches icon 636 which 
in response may change design, preferably returning to its previous design. 

[00084] To capture an image that is being displayed in image 
window 624, user 10 touches the designated icon, here illustrated as icon 
634, in control panel 630 and imager 100 is placed in image capture mode 
and the instruction is processed as described above. In response, icon 634 
may change design, such as becoming highlighted, and a confirmation 
message that the desired action is being performed will be displayed. 
Similarly, image capture mode can be accessed if user 10 engages the 
appropriate control on CCU 30 to capture image 26 that is being displayed in 
image window 624. Instruction is processed as described above and icon 
634 may change design, such as becoming highlighted, and a confirmation 
message that the desired action is being performed will be displayed. 

[00085] To allow user 1 0 to monitor available resources on a 
multimedia disc, multimedia status 610 includes fields identifying the 
remaining capacity of disc and the number of images captured and the length 
of time of image stream 25 recorded. 
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[00086] The archival mode is accessible from control panel 630 to 
review and/or manipulate saved documentary recording files and graphics 
file. User 10 touches the designated icon, here illustrated as icon 638, and 
review page 440 is displayed as depicted in Fig. 13 according to one 
embodiment of the present invention. Page 440 preferably includes a control 
panel 630a, note area 670, file directory 660, image panel 620 including 
image window 624, image status bar 622, and controls 626. Controls 626 
preferably include pause, playback, print and confirmation means as well as 
elapsed time and other controls as deemed useful and/or necessary. 

[00087] Therein, a graphic file may be printed to printer 45 located in 
the surgical suite so that it is immediately available for review by user 10. 
Software is provided to enlarge and view and manipulate the graphic file such 
as providing visual contrast, inserting a scaled file object corresponding to a 
physical prosthesis and thus determining whether such prosthesis fits patient 
5. 

[00088] In accordance with one embodiment of the present 
invention, sensor 318 (see FIG. 4) is provided for detecting an infrared remote 
control signal. Sensor 318 enables user 10 to remotely operate imager 100. 
Sensor 318 is in communication with the processor or Microprocessor main 
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board (MMB) 115, the sensor receiving control signals to operate the medical 
instrument. 

[00089] In accordance with one embodiment of the present 
invention, a system for speech recognition is provided for user 10 interaction 
with imager 100. Microphone 40 receives user 10 voice commands, which 
are routed to speech recognition module 319. Speech recognition module 
319 is software that executes on Microprocessor main board (MMB) 115 to 
receive voice signals that control the medical instrument. 

[00090] In accordance with one embodiment of the present 
invention, database module 321 provides a database server and/or database 
management application that is operatively provided to enable user 10 to 
access, manage and/or update data in imager 100. Database module 321 is 
software that executes on Microprocessor main board (MMB) 115 to establish 
control signals to operate the hard drive and the optical media drive. 

[00091] In accordance with one embodiment of the present 
invention, expert system 323 is provided wherein characteristics of video 
signal 300 meeting predetermined characteristics are automatically brought to 
the attention of user 10 and/or saved as graphic files 810. Expert system 323 
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is software that executes on Microprocessor main board (MMB) 115 to 
generate control signals to operate the medical instrument. 

[00092] In accordance with one embodiment of the invention, a 
stereoscopic module 324 is provided for associating a plurality of video 
signals 300 with each other, as such providing stereoscopic images on a 
display unit. Stereoscopic module 324 is software that executes on 
Microprocessor main board (MMB) 115 to associate a plurality of files to 
provide stereoscopic images on a multimedia interface. 
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What is claimed is: 

1 . A device for medical video recording comprising: 
an endoscope; 

a digital media; and 

an imager in communication with said endoscope, said imager converting 
energy received from said endoscope to signals that are contemporaneously 
stored onto said digital media. 

2. The device of claim 1 further comprising an encoder in communication 
with said imager, said encoder compressing said signals. 

3. The device of claim 1 wherein said media is an optical disc. 

4. The device of claim 3 wherein said media is a digital versatile disk. 

5. The device of claim 4 wherein said stored signals are stored as VOB files. 

6. The device of claim 2 wherein said encoder is an MPEG encoder. 

7. The device of claim 1 wherein said imager is a solid state device. 

8. The device of claim 1 wherein said imager includes a still frame grabber. 

9. The device of claim 8 wherein said imager stores still frames on said 
media. 

10. The device of claim 1 further including a touch screen for entering control 
commands for said imager and said endoscope and said touchscreen is 
responsive to a touch by a user. 



WO 2004/025963 



PCT/US2003/029012 



-34- 

1 1 . The device of claim 10 further including a housing, said housing enclosing 
said imager. 

12. The device of claim 1 1 wherein said touch screen is at least partially 
retractable within a footprint of said housing. 

1 3. The device of claim 1 1 wherein the touch screen is slidable at least 
partially out of a footprint of said housing. 

14. The device of claim 1 1 wherein the touch screen is deflectable relative to 
said housing. 

1 5. The device of claim 1 1 wherein the touch screen is pivotable relative to 
said housing. 

16. The device of claim 10 wherein said touch screen displays said signal. 

1 7. The device of claim 1 wherein said signal is electromagnetic energy. 

1 8. The device of claim 1 wherein said signal is direct current energy. 

1 9. A medical instrument having touch screen control comprising: 
a touch screen for entering control commands; 

a processor for receiving said control commands and for generating 
control signals to operate said medical instrument; and 

a housing for enclosing said processor; said touch screen movable 
between a first position at least partially within a footprint of said housing and a 
second position extended from said footprint of said housing. 
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20. The medical instrument of claim 19 in which said touch screen is 
unpluggable from said housing. 

21 . The medical instrument of claim 19 in which said housing and said touch 
screen include stackable mating plug portions. 

22. The medical instrument of claim 20 in which said touch screen can be 
used by a plurality of medical instruments. 

23. The medical instrument of claim 19 in which said touch screen is 
deflectable about an axis of said housing. 

24. The medical instrument of claim 23 in which said touch screen is easier to 
deflect in one direction than in the other direction. 

25. The medical instrument of claim 23 in which said touch screen is more 
difficult to deflect in the opening direction than in the closing direction to permit 
said touch screen to be tapped without unintentionally deflecting said touch 
screen. 

26. The medical instrument of claim 19 in which said touch screen presents a 
keyboard to a user. 

27. The medical instrument of claim 19 further comprising a sensor in 
communication with said processor, said sensor receiving control signals to 
operate said medical instrument. 
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28. The medical instrument of claim 19 further comprising a speech 
recognition module executing on said processor, said speech recognition module 
receiving voice signals that control said medical instrument. 

29. The medical instrument of claim 1 9 further comprising a expert system 
executing on said processor, said expert system generating control signals to 
operate said medical instrument. 

30. The medical instrument of claim 19 in which said touch screen slides out 
of said housing. 

31 . The medical instrument of claim 1 9 in which said touch screen slides out 
of said housing and is deflectable. 

32. A video recording and image capture device for recording data 
comprising: 

a main board; 

a first and second bus in communication with said main board; 

an interface operable to receive a signal and forward the signal to said first 

bus; 

an imager in communication with said main board, said imager recording 
said signal while contemporaneously writing said signal, said imager operably 
connected to said second bus; and 

a touch screen connected to said second bus and responsive to a touch 
by a user, said touch screen for entering control commands for said interface. 
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33. The device of claim 32 wherein said interface is operable to receive and 
process said signal into an MPEG stream, said interface connected on said first 
bus to the main board. 

34. The device of claim 32 and 33 wherein said imager records and writes 
said files as an MPEG stream. 

35. The device of claim 32 further comprising a database module executing 
on said main board, said database module structuring storage of said files, 

36. The device of claim 32 further comprising a sensor in communication with 
said main board, said sensor generating control signals to operate said device. 

37. The device of claim 32 further comprising a speech recognition module 
executing on said main board, said speech recognition module generating control 
signals to operate the device. 

38. The device of claim 32 further comprising an expert system executing on 
said main board, said expert system generating control signals to operate said 
device. 

39. The device of claim 32 further comprising a stereoscopic module executing 
on said main board, said stereoscopic module associating a plurality of files to 
provide stereoscopic images on said interface. 

40. The device of claim 32 wherein said interface comprises at least one relay 
to route an input signal to a corresponding output connector for providing an 
output signal regardless of the operation status of said device. 
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41 . An interface for processing a signal for recording video into a multiple 
frame layer comprising: 

a controller for an inter-ic bus for providing a multiple master digital 
connection; 

an analog to digital converter for converting a video signal to a first digital 
stream, said converter operably connected to said inter-ic bus; 

a video compression and decompression integrated circuit for encoding 
said first digital stream into a second digital stream having frames, and decoding 
said second digital stream, said video compression and decompression 
integrated circuit operably connected to said inter-ic bus; and 

a programmable buffer for selectively saving frames handled by said 
controller, said buffer operably connected to said controller and said video 
compression and decompression integrated circuit, and said buffer inserting said 
frames into said second digital stream for decoding. 

42. A method for recording an MPEG file for documenting surgical procedures 
while displaying an MPEG stream and a plurality of selected still image files 
corresponding to the MPEG stream, comprising the steps of: 

providing a first digital data stream comprising a video signal, 
providing a second digital data stream comprising an audio signal, 
multiplexing an MPEG data stream from said first and second digital data 
stream, 
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streaming said MPEG data stream to an imager operably connected on a 

bus; 

writing said MPEG stream to said imager; 

displaying said MPEG stream on a display unit; 

selecting a number of frames from said MPEG stream; 

converting the frames to still image files; and 

multiplexing a signal to said display unit by adding the still image files, 

43. The method of claim 42 in which said still image files are in JPEG format. 

44. The method of claim 42 in which said still image files are in BMP format. 

45. The method of claim 4 in which the still image files are in TIFF format. 
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Fig. 8 
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Fig. 10 
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